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S 

^/ ince their official introduction, the Interna- 
tional Classification of Diseases, 10th Revision (ICD- 
10)/ and the Diagnostic and Statistical Manual of Men- 
tal Disorders, Fourth Edition (DSM-IV),^ operational 
classification systems have largely become an integral 
part of the body of knowledge of psychiatrists through- 
out the world and instruments they constantly refer to. 
In this article I look at some of the questions that have 
been raised in connection with these classifications, both 
as a result of the growing number of critical analyses 
and of my own experience. This short contribution does 
not claim to provide exhaustive answers, but merely to 
stimulate further discussion. 

Psychiatrists probably all started adopting operational 
diagnostic classification systems, such as the ICD and 
DSM classifications, on the assumption that the reha- 
bihty of the diagnoses therein defined was unequivo- 
cally demonstrated to be very high across the centers 
and even countries of evaluation, without realizing that 
the general consensus was based on the lowest level of 
validity conceivable, since it resulted from the mutual 
agreement of experts rather than on any proven facts 
concerning the etiology of mental disorders. This means 
that in the absence of biological markers for most psy- 
chopathological disorders, diagnostic features were 
based on clinical descriptions, resulting in "official" noso- 
logical groupings. One of the main objections raised by 
clinical psychiatrists was that in many instances diag- 
noses were based on the numbers of certain symptoms.^ 
Nevertheless, in spite of initial warnings of oversimplifi- 
cation, the two most widely used official classifications — 
DSM and ICD — came to be largely regarded as noso- 
logically valid by medical doctors, official institutions, 
and even the pubHc at large. The interesting, but logical, 
paradox is that those least satisfied with these so uni- 
versally acclaimed classifications are probably the psy- 
chiatrists. In this article, I would like to briefly discuss 
two frequently asked questions: (i) what is the vaUdity of 
the current diagnostic process? and (ii) what are the 
weak points of the DSM and ICD classifications? 



The term "nosological classification" is often used in 
connection with medical classification systems, and 
the tendency is to equate it with "diagnosis" and 
"validity. " However, particularly in the case of psychi- 
atry this is far from always being the case. From a sci- 
entific point of view, the two most up-to-date classifi- 
cation systems in use today— the Diagnostic and 
Statistical Manual of Mental Disorders, Fourth Edition 
(DSM-IV), and the International Classification of Dis- 
eases, 10th Revision (ICD-10) — may be considered as 
the theoretical basis of current psychiatric nosology. In 
this paper we show that the instru mentally gener- 
ated DSM-IV or ICD-10 diagnoses of schizophrenia 
have relatively low validity in comparison with clini- 
cian expert diagnoses. If medical classification is to be 
realistic, simple to use, and reliable, nosological sys- 
tems must be based not only on established facts, but 
also on theoretical assumptions regarding the nature 
of disease. 
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What is the validity of 
the current diagnostic process? 

Clinical psychiatric practice is mainly based on unstruc- 
tured interviews. This approach yields excellent results in 
terms of diagnosis, provided it is carried out by experi- 
enced clinicians; unfortunately it is the least objective, 
reproducible, and rehable one."^ 

The answer to this problem would appear to be vali- 
dated rating scales, administered by trained examiners. 
However, although such scales prove very reliable in 
terms of interrater and intertest results and validity, this 
applies only to symptoms and syndromes and not to 
diagnoses. 

Structured interviews have relatively high reliability 
yet lower validity because this type of interview does 
not provide a framework that makes it possible to fol- 
low all the leads that a patient may offer. Previous 
psychiatric history, information from the entourage, 
previous response to medication, as well as difficult-to- 
define features related to "clinical impression" are 
usually omitted from operational definitions. There is 
nearly no room for clinical hunches or intuition on the 
part of the doctor using the DSM-IV or ICD-10 clas- 
sifications. 

Karl Popper is noted for stating that the ultimate test 
for the validity of a theory is to try to disprove it. If the 
theory stands the test, we may keep it, but if it fails, 
then it should be replaced by another theory.^ With this 
in mind, I would hke to discuss the findings of a study I 
carried out at the Mental Health Qinical Research Cen- 
ter (MHCRC) of the University of Iowa College of 
Medicine on the reproducibility and validity of the 
ICD-10 and DSM-IV clinical and operational diagnoses 
of schizophrenia, which clearly showed the hmitations 
of structured diagnostic interviews for schizophrenia. 
This study compared chnical diagnoses made by chni- 
cians using unstructured interviews and operational 
diagnoses generated from a computer algorithm 
derived from the Comprehensive Assessment of Symp- 
toms and History (CASH).' 

Background 

The DSM-IV nosological concept of schizophrenia has 
been strongly contested by many researchers, such as, 
for example, Maj in 1998.^ Schizophrenia, as defined by 
DSM-IV, does not follow any "classic" paradigm. It is a 



diagnosis by exclusion. The symptomatological, chrono- 
logical, and functional criteria, taken together, are not 
sufficient to characterize schizophrenia as a syndrome, 
so that exclusion criteria are decisive for the diagnosis. 
What we currently call schizophrenia is merely a het- 
erogeneous group of nonaffective psychotic syndromes 
whose etiology is unknown. Does the schizophrenic syn- 
drome have a special character that cannot be trans- 
lated into operational terms? Does the diagnosis of the 
trained psychiatrist rely on a hohstic impression of the 
subject, which operational criteria are unable to com- 
municate? Do DSM-IV criteria fail to catch one or 
more chnical aspects that are essential for the diagno- 
sis? If all essential elements of the schizophrenic syn- 
drome are present in the DSM-IV definition, are they 
described in insufficient detail? Or is the clustering of 
symptoms not appropriately defined? 
Most databases for biological research in psychiatry are 
now produced with the help of structured diagnostic 
interviews. Structured interviews represent the main- 
stay of diagnostic instruments in psychiatry, particularly 
those which allow some freedom to follow individual 
leads that may emerge. They can also be programmed 
for computerized scoring. For example, the Schedule 
for Clinical Assessment in Neuropsychiatry (SCAN)^ 
and Comprehensive Assessment of Symptoms and His- 
tory (CASH)'^ are excellent structured interviews and 
recording instruments for documenting the signs, symp- 
toms, and history of subjects evaluated in research stud- 
ies on the major psychoses and affective disorders. Nev- 
ertheless, structured interviews have substantial 
limitations that restrict their diagnostic validity. Any 
diagnosis that rehes on the subjective interpretation of 
patient reports or laboratory tests, as well as on instru- 
mental assessment, carries some risk of error. This error 
may be due to the equipment used (faulty equipment, 
poor calibration), to human error on the part of the 
assessors (poor training, carelessness, mislabeled sam- 
ples or reports), or to the patients (misreporting or 
inconsistency in what patients say or do). Almost all 
diagnostic procedures include one or other of these ele- 
ments. Medical diagnosticians are not infallible, and 
probably will never be so.'^ 

Structured interviews provide broad descriptive coverage 
in order to enable investigators to make diagnoses using 
a variety of criteria, but they cannot provide an appro- 
priate instrument for making a differential diagnosis. The 
vahdity of arbitrarily constructed diagnoses can be tem- 
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porary only. When a disorder becomes better under- 
stood, the symptoms held to be the most reliable may 
well prove to lose their importance as indicators of the 
condition. In time, phenomenologically (arbitrarily) 
constructed diagnoses and clinician "gold standard" 
diagnoses should logically diverge. The poorer the cor- 
relation between the construct and the chnician diag- 
nosis, the greater the probability that the construct does 
not reflect contemporary knowledge and should be cor- 
rected or replaced. 

Aim of the study 

The aim of the study was to answer the following ques- 
tions: (i) Is there a satisfactory correlation between 
computer-processed (ie, algorithmic) ICD-10 diagnoses 
and clinician ("gold standard") diagnoses of schizo- 
phrenia? (ii) Is there satisfactory correlation between 
computer-processed (ie, algorithmic) DSM-IV diag- 
noses and clinician ("gold standard") diagnoses of 
schizophrenia? (iii) In which way does the degree of 
correlation affect the diagnostic validity of ICD-10 and 
DSM-IV schizophrenia? 

Hypothesis 

Assuming the expert clinician diagnosis ("holistic 
approach") is valid, observation of a low correlation 
between clinician and algorithmic diagnoses reflects the 
low validity of the algorithmic diagnosis. 



Methods 

• The medical records of 43 subjects used in the DSM- 
IV Field Trial Iowa Site were analyzed. DSM-IV diag- 
noses as well as ICD-10 diagnoses were made, using 
unstructured interviews (chnical expert diagnoses), 
and the structured, operational diagnostic (CASH) 
method, which records the relevant signs and symp- 
toms (algorithmic diagnoses). To enhance the vahdity 
of the results of the unstructured psychiatric exami- 
nations, we controlled all 43 medical records with 
regard to the consistency of the objective medical and 
subjective patient data. The symptoms and syndromes 
listed in CASH were carefully evaluated by well- 
trained MHCRC speciahsts. 

• The diagnostic algorithm was applied directly to the 
CASH diagnoses. 

• Diagnostic algorithms were prepared for, and applied to, 
the DSM-IV and ICD-10 diagnoses of schizophrenia. 

• Algorithmic diagnoses and expert clinician diagnoses 
were correlated by calculating the kappa coefficient 
(Table I). 

• Possible explanations for the observed diagnostic dis- 
cordance were proposed. 

Results 

As can be seen in Table /, only a marginal correlation 
between expert clinician and algorithmic DSM-IV and 
ICD-10 diagnoses of schizophrenia was found. Assuming 



• DSM-IV algorithm 



Expert clinician diagnoses 

kappa 0.34 

• ICD-10 algorithm 

Expert clinician diagnoses 

kappa 0.37 

kappa >0.75 excellent correlation 

0.4<kappa<0.74 good correlation 

kappa<0.4 marginal correlation 



Table I. Correlation between DSM-IV / ICD-10 diagnoses and expert clinician diagnoses. 



187 



Clinical research 



the expert clinician diagnoses of schizophrenia (made 
by the "hohstic approach") were indeed vahd (the "gold 
standard"), the implication is that the validity of algo- 
rithmic diagnoses was relatively low. 
Four main limitations of the arbitrarily made diagnoses 
of DSM-IV and ICD-10 schizophrenia were found, relat- 
ing to: (i) symptom severity thresholds; (ii) evaluation of 
the mood syndrome; (iii) specification of psychotic/mood 
duration ratio; and (iv) ICD-IO/DSM-IV differences in 
the specification of hallucinations. 

Discussion 

The results of the study show that instrumentally gener- 
ated DSM-IV or ICD-10 diagnoses of schizophrenia had 
relatively low validity when compared with clinician 
expert diagnoses. These findings are in agreement with 
the views expressed by Maj in his editorial,^ and lead to 
the following questions: 

• Is it possible to determine whether the operational 
approach is disclosing the intrinsic weakness of the 
concept of schizophrenia or the intrinsic limitations 
of the operational approach? 

• Is there, perhaps, beyond the individual phenomena, a 
"psychological whole" that the operational approach 
fails to grasp, or is such a "psychological whole" simply 
an illusion that the operational approach unveils? 

• Is there a possibility that the potential of the opera- 
tional approach has not been fully tapped? For exam- 
ple, some important "classic" features such as autism 
were omitted in the operational criteria of schizo- 
phrenia. 

• Does the form and content of the subjective experi- 
ences of individuals who are diagnosed as having 
schizophrenia require more in-depth investigation and 
characterization, reversing the recent process of reduc- 
tion of psychotic phenomena to their lowest common 
denominator? 

What are the weak points of 
the DSM and ICD classifications? 

After years of experience with the DSM-IV and ICD-10 
classifications, some more or less anticipated weak 
points of these classifications have become evident. 
Many critical analyses have been published, eg, the 
recently published article by Tucker. The current DSM 
and ICD process gives the image of precision and exact- 



ness. Indeed, we as psychiatrists have come to beheve 
that we are dealing with clear and discrete disorders 
rather than arbitrary symptom clusters. We are now 
being taken at our own word by managed care compa- 
nies that stipulate that if a patient's symptoms fulfill cur- 
rent criteria for schizophrenia or recurrent depressive 
disorder, drug treatment must be given strictly according 
to the textbook. In fact, to quote Gary J. Tucker "at best, 
we are between Scylla and Charybdis — we no longer 
want to say that each patient is a unique individual, nor 
can we honestly say that every case clearly fits diagnos- 
tic criteria."^° All of this apparent precision overlooks 
the fact that, as yet, we have no identified etiological 
agents for psychiatric disorders. In psychiatry, no matter 
how scientifically and precisely we use scales to evaluate 
the patient's pathological symptoms, all we are really 
doing is simply pattern recognition. We are still only 
making an empirical diagnoses and not etiological ones 
based on disruptions of structure of function. 
After these considerations I would like to briefly con- 
sider some more optimistic perspectives that I believe 
could positively influence psychiatric classification and 
nosology in the near future. New, exciting concepts 
and paradigms are looming on the horizon of psychi- 
atric classification. New intellectual frameworks for 
psychiatry have been introduced, for example by Kan- 
del, who proposes that the genes expressed in the 
brain encode proteins that play important roles at spe- 
cific stages of the development, maintenance, and reg- 
ulation of the neural circuits that underlie behavior. 
Modern cognitive psychology is exploring language, 
perception, memory, motivation, and skilled move- 
ments in ways that are proving to be stimulating, 
insightful, and rigorous. The recent merger of cognitive 
psychology with neural science, to give birth to cogni- 
tive neuroscience, is proving to be one of the most 
exciting areas in biology. 

Through these and others hypotheses, psychiatry is 
searching for a new identity and a new nosological 
approach. ICD-10 and DSM-IV have offered psychia- 
trists worldwide consensual and more or less valid diag- 
nostic hypotheses. But now, after years of extensive use, 
the time has come for a critical appraisal of both classi- 
fications. A renewed involvement of psychiatry with 
biology and neurology is not only scientifically impor- 
tant, but also epitomizes the scientific competence that 
should be the basis for the chnical specialty of psychia- 
try in the near future. 
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As for clinical assessment, I fully agree with Tucker that 
the time has come to merge the empirical psychiatry of 
today's classification systems with the story and actual 
observation of the patient. Accurate observation of symp- 
toms and the story of the patient must be included in our 
diagnostic processes."^ Perhaps multiaxial classification will 
prove to be one of the ways out of oversimplification. 
A renaissance of psychopathological research should be 
encouraged. Several excellent and very sophisticated 
tools like SCAN or CASH have already been developed, 
but unfortunately their interpretation and even their ter- 
minology is not identical. We should work carefully on 
achieving a broad international consensus on the assess- 
ment and terminology of psychological signs and symp- 
toms, in the same way that we worked on the whole sys- 
tem of psychiatric classification some years ago. 
I would Hke to conclude with a quotation from my won- 
derful host and coworker from Iowa, the excellent clini- 
cian and researcher Nancy Andreasen, and propose an 
answer to one of the questions posed by the recently 
deceased distinguished Danish psychiatric taxonomist 
and great friend of mine from Arhus, Eric Stromgren. 



Nancy Andreasen wrote in a very recent article^^: 
"While evidence-based decision making is a core value 
of medicine, and while DSM has done a valuable service 
in standardizing diagnostic practices, we as physicians 
must also devote a part of our time and energy to under- 
standing how our patients feel and think and change 
subjectively. This is central to our role as doctors — if we 
are going to help them as healers, and if we are going to 
develop innovative insights about disease processes to 
test in research paradigms." 

Eric Stromgren asked in 1992^: "We are carried on by a 
huge taxonomic wave. Returning to classification, to tax- 
onomy, we must ask the question: Are we just now in 
what could be called a 'taxonomorphic' age?" 
It seems to me that the right answer to Stromgren's 
question today is: "Yes, we are." □ 

This study was conducted while the author was the recipient of a Fulbright 
Grant No. 20996. Hosts: Nancy C. Andreasen, IVID, PhD; Andrew H. Woods, 
Professor of Psychiatry, Director, IVIental Health Clinical Research Center, 
University of Iowa Hospitals and Clinics, 200 Hawkins Drive, Iowa City, Iowa 
52242, USA. Computerized algorithm for the CASH and statistical analyses 
was provided by Dr Beng Choon Ho. Dr Michael Flaum was the main advisor 
for the project design. 



Validez de la clasificacion nosologica 

El termino "clasificacion nosological' es utilizado 
frecuentemente en relacion con los sistemas de 
clasificacion medica y se tiende a equipararlo a 
"diagnostico" y "validez''. Sin embargo, especialmente 
en el dmhito de la psiquiatna, esto dista mucho de la 
realidad. Desde un punto de vista cientifico, los dos 
sistemas de clasificacion hasta ahora mas utilizados -el 
Diagnostic and Statistical Manual of Mental Disorders, 
en su cuarta edicion (DSM-IV) y la decima version de 
la Clasificacion Internacional de las Enfermedades 
( CIE-10)- pueden considerarse como la base teorica de 
la nosologia psiquidtrica actual En este arttculo, nos 
proponemos demostrar que los diagnosticos de 
esquizofrenia del DSM-IV y de la CIE-10, concebidos 
de manera instrumental, poseen una validez 
relativamente baja en comparacion con los diagnosticos 
establecidos por cUnicos expertos. Si la clasificacion 
medica debe ser realista, de uso simple y fiable, los 
sistemas nosologicos deberian no solo establecerse 
sobre hechos observados sino tambien sobre la base de 
supuestos teoricos relativos a la naturaleza de la 
enfermedad. 



Validite de la classification nosologique 

Le concept de "classification nosologique" est 
frequemment utilise en rapport avec les systemes de 
classifications medicales et la tendance actuelle est de 
le mettre sur un pied d'egalite avec "diagnostic'' et 
"validite". C'est pourtant loin d'etre vrai dans Men des 
cas, en particulier dans le domaine de la psychiatric. 
D 'un point de vue purement scientifique, les deux sys- 
temes de classification les plus recents utilises de nos 
jours, le Diagnostic and Statistical Manual of Mental 
Disorders, quatrieme edition (DSM-IV) et I'lnterna- 
tional Classification of Diseases, dixieme revision 
(ICD-10), peuvent etre consideres comme le fonde- 
ment theorique de la classification nosologique psy- 
chiatrique actuelle. Cet article souligne le fait que la 
validite du diagnostic de schizophrenic base sur les 
criteres du DSM-IV ou de I'lCD est relativementfaible 
comparativement a celle du diagnostic base sur I'ob- 
servation clinique pure. Si une classification medicale 
se doit d 'etre realiste, facile a utiliser et fiable, les sys- 
temes nosologiques se doivent quant a eux d 'etre bases 
non seulement sur des faits averes, mais egalement sur 
des hypotheses theoriques concernant la nature de la 
maladie. 
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